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ABSTRACT 

The purpose of this study was to assess the reading 
growth of pupils in the Pinellas County (Florida) Reading Systes 
(PCRS) as coipared with pupils in other types of reading prograss. 
Data on 757 children in the target schoo ^ and 768 children in the 
coiparison schools was analyzed. The conclusions reached in this 
evaluation were: that this study corroborates the findings of the 
earlier interim evaluation of PCRS; that despite consistently gzea'cec 
than expected gains, the PCRS gains were not statistically larger 
than were the gains in coiparison schools; that in view of these 
findings, it appears that both the PCRS and the sore traditional 
reading progras produce better that, expected reading gains; that cost 
estisates suggest the PCRS was less expensive than the tri-basal 
approach used in the conparison schools; and that no conclusion can 
be reached about coiparative pupil, parent, and teacher attitudes as 
a result of this evaluation. (Data is presented in both narrative and 
table forss.) (RB) 
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iNTiiODi ICTION ^£$1 CO?^ WIMIABLE 

In IX^ccmber, 1973, ilic Ucsciirch, Evaliiaiion and IMamiing 
rXipartment prepared an Interim rivaluaiion of the I'incUas County 
Keatling stem for tfie year 1972-73. riuu study did not compare 
schools using the IMncllas County Reading System (PCRS) witli tiiose 
whicli did not. It assessed i-eading achievement of the pupils only in 
the six PCRS target schools. The results of the study indicated that, 
according to Gates-McGinitie norms, pupils in the PCRS schools 
showed achievement consistent with or in excess of statistical expec- 
tation. 

The present study differs from the interim study in three 
respects. First, the six PCRS target schools were compared with 
six non-PCRS schools. Second, the results of the countywide testing 
program were used (ratlier than a special administration of the 
Gates- Me Ginitie Test, as was used in tlie interim evaluation). Third, 
the present study eliminated pupils who transferred into or out of the 
PCRS and non-PCRS schools during the pei*iod from January 1, 1973, 
to June, 1974. Thus, all pupils whose scores are summarized in 
tills study were in attendance in die PCRS schools for at least one and 
one-half years. 

DESIGN 

Pur|:)ose 

The putposc of this study was to assess the reading growth 



REST COPY AVAIWBI F 

of pupils in tlie i'*incllns Couniy Heading System as compared with 
pupils in otiier lypes of reading prograr.r*. Tlie Pinellas Couniy 
Heading System was developed in 1971-72 by icacliers and reading 
supervisors as a response to pupil needs and community interest 
in an alternative reading program. 'Hie basic principles of tiiis sys- 
tem are (l).thc precise definition of instructional aims in five broad 
areas -- readiness, word perception, comprehension, sti-tdy skills, 
and on-going skills; (2) the specification of procedures for achieving 
those aims, involving diversified learning resources; and (3) continuous 
monitoring of each pupil's status and progress. The major objective 
of the reading system is the individualization of reading instruction, 
so diat each pupil receives individual diagnosis, treatmrint and evalua- 
tion of progress. 

Population 

The six schools used for the Pinellas County Reading System 
sample were Gulfport, Orange Grove, Ozena (only grades 2 and 3), 
Sunshine, Tari^on Springs and Woodlawn. Hie six schools selected 
as comparison schools were Cross Ikiyou, Euclid, Lealman, Melrose, 
Oldsmar and Ridgecrest. As Indicated previously, the data analyzed 
in this study was resiricied to diose pupils (in both the PCRS and comparison 
schools) who had been in the same school since January, 1973. In 
addition, only those j^dpils who were present in school on the days when 
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the pre -lost and pust-icst were administered were included in tlic 
analysis. 'Plie total number of children whose data was analyzed 
was 757 in liie target schools and 768 in the comparison schools, 
A table displaying the number of cases in each grade in each school 
categoi7 appears, *n Appendix A. 

Test Instruments 

The analyses were based on the reading sub-tests of tlic 
Metropolitan Achievement Test. The levels used in each grade, in 
accordance with the publisher's recommendation, were as follow: 

Pre -test Post-test 
2nd grade Primary I Primary II 

3rd grade Primary il Elementary 
4th grade Elementary Elementary 

5th grade Intermediate Intermediate 

A nalysis 

Although tlie statistical analyses were conducted on actual 
raw test scores, tlie results are reported in terms of grade equivalents. 
It should be kept in mind that the conversions from actual test scores 
to grade equivalc^nts are based on the test publisher's norm tables, 
and that these tables arc subject to artificial fluctuation over short 
periods ot time. The intci*val bct\vecn pre -testing and post-testing in 
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lliis-Miudy was sc'VCMi inonihs (Ociolx^r, 1973 - May, 1974). Thus, 
Llic grade equivalents rcporicd in iliis study nrc subject to such 
Uuctuatioiis. 

Tlic statistical n.jthod used was the analysis of covariance, 
the post-tost being the dci:)endent variable and the prc-tcst being t!io 
covariate. 'Huis, the statistical analysis was conducted on tlic post- 
test scores, using the pre -test scores to adjust for any differences 
between die two school catcgoiies in the entry reading levels of 
pupils. 

Because of the fluctuations introduced by the final conversion 
to grade equivalents, the careful reader will note slight inconsistencies 
among the tables. A working rule for avoiding misinterpretation is 
to regard differences of . 1 in grade equivalent as not meaningful. . 

The expected gains used in this study are based on the pupils* 
average yearly growth rate up. to the time of the pre -testing. The 
expectation index is thus a simple projection into the futurc of the rate 
of growth in the past, (It is computed by dividing the number of years 
of achieved grade equivalent by tlie number of years of grade place- 
ment). The average yearly growtii rate is then applied to the interval 
of measurement (7 months) to arrive at an expectation index. 

RESULTS 

The analysis of covariance failed to reveal significant 
differences in overall reading performance between tlic PCRS and 
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comparison schools (scu Tables 1 and 1 A). Moili the I'CRSand the 
comparison scliools sliowcd significant achlcvc;mcnt gains in reading 
(sec Tables 2 and 2 A), in most cases in excess of expectation (see 
Table 5). Both school types showed lower cntiy reading levels than 
the county as a whole, but gains similar to countywidc gains. 

An analysis was conducted on the reading growth of boys 
and girls separately. No significant difference was found for either 
boys or girls which could be attributed to PCRS (see Tables 3 and 3 A). 
Finally, the analysis was conducted comparing the PCRS and comparison 
schools in terms of low, average and high reading achievers. (These 
classifications were based on pre-test performance of pupils). No 
significant differences were found between the PCRS and comparison 
schools for any of tlie ability groups (see Tables 4 and 4 A). 

LIMITATION 

A trend toward individualization in all instructional programs 
and strategies delimits this study, The PCRS gives first priority to in- 
dividualization, and develops the program from this premise. The 
nore traditional programs, however, also are moving toward in- 
dividualization through the adaptation of standard materials, the use of 
supplementai7 materials, and the increased commitment and ability of 
teachers to meet individual needs. In summaiy, it can be stated that 
to a greater or lesser degree the individualized approach has been in- 
jected into the "traditional" approaches. Thus, this evaluation cannot 



ix: viovvcti as a coiiiparison of the POKS with a siricily non-sysicMiis, 
non-inJividuali/cJ reading approach. This limitation docs not 
necessarily ini|)ly iluit liad the I^CIIS been compared to a totally non- 
sysiems, non-individiialiijcd approiich (which perhaps does not exist 
in the county) that the results would have favorctKtlje PCRS. It only 
suggests that the outcome may have been different. 

CONCLUSIONS 
• The major conclusions reached in this evaluation follow: 

1, This evaluation corroborates the findings of the earlier in- 
terim evaluation of PCRS. It was again found that tlie 
reading gains made by pupils in the PCRS were greater than 
gains expected on tlie basis of past reading growth. 

2. Despite these consistently greater than expected gains, the 
PCRS gains were not statistically larger than were the gains 
in the comparison schools. 

3. In view of the twr findings above, it appears that both the 
PCRS and tlie more traditional reading program in tlie county 
are methals which produce better than expected gains in 
children's reading. Thus, in terms of cognitive growth, 
cither is acceptable as an approach to the teaching of reading 
in the county. 

4, The Elementaiy fiducation [3epartmcnt of the Division of 
Curriculum and Instruction has estimated the costs for 
the PCRS and the reading programs in the comparison 
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schools ust'tl in this .simly. The rcsiilis indicaic iIku [\\c 
yearly I'C'KS cosi„ when iiinorii/ed over four years, was 
less than the cost of the tri -basal approiich used in the 
comparison schools, rhus, the results of this cognitive 
evaluation, when combined with thest^ cost estimates, 
suggest that the PCRS was higlier in cost efficiency than 
was the more traditional tri-basal approach. Specifically, 
similar cognitive. results were achieved in the PCRS for 
approximately 15% less yearly materials and maintenance 
cost. In addition, start-up and maintenance costs for im- 
plementing both the system and the tri-basal approach in 
new 24 -teacher schools were estimated. Again, the yearly 
difference when all costs were amortized over a four-year 
period favored the PCRS by approximately 15%, i.e., the 
PCRS projected yearly costs for materials and maintenance 
were approximately 15% less than were similar projected 
costs for the tri-basal apprrjach. The details of the estimates 
are available from the Elementary Education I>cpart- 
ment. 

No conclusion can be reached about comparative pupil, 
parent and teacher attitudes as a result of this evaluation. 
This evaluation focused on cognitive growth only. In the 
1974-75 evaluation a comparison of pupil, parent and 
teacher attitudes toward the PCRS and the tri-basal system 
will be undertaken. 

8 
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taim-l; 1 



PCHS r.chool.G and Coinji.irifion Sclioolr. 







Statir.tic-illy Ad-)u:vted He<in Pocit: 
Grade KnuT v.ilo.Til.r: (Par-od on Heti'O 70 


MoriTiR ) 


Grdide 


2 


0 PCRS 
Schooli; 

2.6 


n 

(201) 


6 Comparison 
School r. 

2.6 


n 

(169) 


Orade 


3 


3.3 


(158) 


3.3 


(136) 


Grade 




3.7 


(213) 


3.9 


(219) 


Grade 


5 


5.1 


(185) 


5.1 


(18»+) 



Interpretation ; The comparison of 6 PCRS schools with 
6 Comparison schools revealed no significant differences 
attributable to program type • In other words, the one 
reported difference in grade equivalents between PCRS and 
comparison schools is not statistically significant. 
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PCKo Scihoolr; eind Coiiijiririr.dn C(:>ioo].r; 



r.r'<.ide 


[>tal;i r;lically .djur.;tr:d Monn Pod 
Pnui va!l ontr; (Hrised on Hctro-ntanforO 


t-Tor,t 

Ilqu.l v.-ilencv flor'iiir. )*' 






6 PCRS 
Sc1\ooTg 


n 


G ConiTiarison 
School:} 


n 


Crade 


2 


2.8 


(201) 


2.8 


(169 ) 


Grade 


3 


3.8 


(158) 


3.8 


(196) 


cVrade 


1+ 


4.3 


(213) 


4.5 


(219) 


Grade 


5 


5 . 6 


(185) 


5.6 


(18U) 



*ThGse conversionn v;ere presented in ''Equivalent Scoros for 
the 1973 Edition of Stanford Ac hievement Test and the 1970 
Edition of Metrorol.i tan ^ ^ AcTTievorrton t Te ntn in Terms of Grade 
Jxiuivalontr.;'* published by Ilarcourt Brace Jovanovich Inc. 
The publif>lier indicated that the main differences betv7eeri 
the 1970 Metropolitan Grade Equivalents and the 1973 Stanford 
GrMde Lquivalentr;. ''reflect v/!iat children are learning in 1973 
ar. cotnpared to .19 70 /' Eur^thor, t:herje convei"^ted r,rade oqu.iva- 
LentG rof].cct the berjt OGtimate of what elementary achievement 
would liavc been (based on current norms) had the S tanfor d test 
battery been used rather than the Metropolit an test battery. 
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•PAliLi: 2 







.PCRS !.Jclu)Olr;, 


ComiiaT'i r.on 


Schools 


an(i 


Tot a J County 








Unadjusted Moaji Pro-ToL-.t 
r, r a '■ 1 o 1 In u i v a 1 o n t ;.; ( b a v> o 


, Poc;t-'rc,<rL- , and Gain 
d on Metro 70 IIotmh:-. ) 












B PCRS 
fJclioolr. 




6 Coin])ari[:;on 
Schools; 






Total 
County 








Pre- 
Test 


POfit- 

Test Gain 


Pre- 


Pont- 
Test 


Gain 


Pre- 

Tect 


Post- 
Te5t_ 


Gain 


Grade 


2 


1.8 


2,6 


.8 


1.8 


2.6 


.8 


1.9 


2.6 


.7 


Grade 


3 


2.5 


3.2 


.7 


2.6 


3.4 


.8 


2.6 


•3.U 


.8 


Grade 


U 


3,2 


3.7 


.5 


3.0 


3.7 


.7 


3.U 


U.l 


.7 


'"•rade 


5 




5.2 




U.3 


5.0 


.7 


U.9 


5.7 


.8 



Interpretation : nunils in both the PCRS and comDaricon Gchooln 

entered the 3rd and 4th grades at lov;er levels than the pupils in the 
county aro a v/hole. Hov/evcr, their gains in reading: were commensurate 
witli countyv;idc gains. (Differences of 0 . .1. in grade equivalent should 
not be regarded as meaningful). The gain of .5, compared to .7, by Uth 
grade pupils in the PCRS schools is the only gain whicli deviates downward 
from the general pattern by more tlian .1. 
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tabu: 2a 



PCRr. 5:ahooln, Comparison fJcboolo and Total County 

rv^.H r UncKljurUod Moc.n ITo-Toot , Post-Tont, and Cain 

nradu Lqmvnlcntr;. (B,ine d on Mntro-St.mford i;r|uiva 1 oncv rJt.r.m.n^» 

f fCRG 6 Comparison Total 
-^^^oo^^' _SchoolF. County 

.^'I" r . P'^e- Post. 

iest ic^t_. Gain Test Cain Test T_est Gain 

^ Metro-Stanford equivalency norms 

are not provided for the pre-test 
^^•''^G 3 batteries given in grades 2 and 3. 




^^c^ footnote of Table lA. 



Id 



PCRI) fichooln i\n<\ Compnrir.on JJohoolf. 

• Boyn and Cirln 

StatiGtically Adjusted Moan Post-Test 
nrncio llqiij v.ilcntr; (H,i;;ed on Metro 70 MoT'in;;) 

G PCRS 6 Comparison 
S chop jr. Schools 

BoyG nirlG Boys Girls 

Grade 7 2.5 2.6 2.5 2.0 



Grade 3 3.2 3.4 3.2 3.U 



Grade U 3.6 3.9 3.7 3.9 



Grade 5 M.9 5.3 5.1 5.3 



Interpretation ; The comparison of boys and girls in 6 PCRS 
schools and 6 comoarison schools revealed -no significant differ 
cnces attributable to program type for either sex. 
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TABLn 3A 

PCRS Schools rind Comp«irJ.Kon Pichools 







Uoyn 


and Gil- Is 






Stcvtintlccjlly Adjuntod Mean Por/t-Tcfst 
i'.oui v.ilcnts (Bdirjed on Metro-Stanford Kquivalencv Mormr. 




6 PCRS 
Schoolfs 


6 Compari 
Schools 


son 




Boyn 


Girls 


Boys 


Girlfj 


Grade 2 


2.7 


2.B 


2.7 


"2.8 


Grade 3 


3.7 


U.O 


3.7 


U.O 


Grade U 




U.5 


U.3 


U.5 


Grade 5 


5.1+ 


5.8 


5.6 


5.8 



*See footnote of Table lA. 
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TAlJLn t 



... 




PCRr; Sclioolrt and Compcirirjon Schoolr? 

Low, Avor.:ij»i? and High Roadinr, Achlovers 

Stat Intically Adiufjtu(J Moan Poat-Tcnt 
Grade! Kquivalentc (Baced on Metro 70 Uorrno) 








6 PCRr; 

S chop In 


< 




6 Comparison 
Schools 






Low 
Reading 
Achievers 


Average 
Reading 
Achievers 


High Low 
Reading Reading 
Ac?'tievers Achievers 


Average 
Reading 
Achievers 


High 
Readin 
Achieve 


(Stanlnes)'' (1,2,3) 


(4,5,6) 


(7,8,9) 


(1,2,3) 


(4,5,6) 


(7,8,9 


Grade. 


2 2.2 


2.6 




2.1 


2.6 




nrade 


3 2.U 


3.6 


5+ 


2..U 


3.6 




Grade 


14 2.9 


U.5 


?♦ 


3.0 


4.7 


?♦ 


''.rade 


5 3.9 


5.7 


7+ 


U.O 


5.7 






*Lov;, r.verage 
achievement , 


* 

and high classif ic.ition by stanines 
i.e., pre-test performance. 


was based on 


entry 



♦''''^The number of pupils in the high stanines ranged from only 18 to 38 
In individual grades. These small samples, combined with the 
variability of the norm tables at the upper extremes, make more ' 
precise conversion unjustifiable. Thus, "+'' should be read as 

"liif,hcr than the lu-?p,lnninj! of the grade equivalent shown." 



Intorp rotatio n ; The comparison of low, average and high reading 
achJcvcrH in IT PCRS schoolfj vs. the 6 comparison schoolr; revealed 
no significant differences attributable to program type for any of 
the ability groups. 
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TAUl.C ilA 

PCRS fidioolii iind Comp.irifjon flchoDln 
Low, AvniMj'.o and High Ro.nJinjv Achiovcrji; 







Sttitiaticilly Adjunled btoan ro;jt-ToGt 
Grvido liquivcilontB (Bar'od on Metro-Sldnforf] Kquivti] cncv llormtj)^ ,• 








f) PCRS 
Schools 






6 Comparison 
Schools 








Low 
Reading 
Achievers 


Average 
Reading 
Achievers 


High 
Reading 
Achievers 


Low 
Readinp. 
Achievers 


Average 
Readihg 
Achievers 


High 
Readin 
Achieve 


(Stanines) (1,2,3) 


(•4,5,6) 


(7,8,9) 


(1,2,3) 


(4,5,*6) ^ 


(7,8,g 


Grade 


2 


2.3 


2.8 




2.2 


2.8 




C'rade 


3 


2.5 


U . 2 


5+ 


2 . 5 


It O 

H . 2 




Grade 




3.5' 


5.1 


7+ 


3.6 


5.3 


?♦ 


Grade 


5 


U.3 


6.3 


8* 




6.3 


8^ 



*S(?f? footnotes of Table lA and Table U. 
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TABLn b 

PCKli .Sclioolr; and Coin|.uAi'iGon [ichoolr: 
Gairif. vs. rxpoctatiori;; 



Unadiusted Mean 
nrado liquivalents (Based on Metro 70 Nprms) 



6 PCRS 6 Comparison 

Schools Schools 







Observed 
Gain 


Expectation 
Index 


Observed 
Gain 


Lxpectation 
Index 


Grade 


2 


.8 


.S 


.8 


.S 


Grade 


3 


.7 


.5 


.8 

r 


• a 


Grade 


U 


.5 


.5 


.7 


.5 


Grade 


5 


.8 


.6 


,7 


.6 



Interpretation ! ^^ains exceeded expectations in both PCRS and comparison 
schools, witn the exception of tht; 4th grade pupils in PCRS schools. 
These pupils matched their expectation index but did not exceed it. As 
indicated on Table 1, the differences between gainr? in the PCRS and 
Comparison schools are not statistically significant. 
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UmiitxT oJ- Pupilr. Analyzo^T 



Gradci 2 Grade 3 Crade 4 Crade 5 



PCRS achoolr, 201 150 213 185 

Compariyon schools 169 196 219 18H 



Boys 202 180 226 196 

Girls 168 17U 206 173 



Low-achievinn readers 

(Pre-test stanines 1,2,3) 128 166 230 155 

Average-achieving reade. 

(Pre-test stanines U,&,6> 18i* 126 160 178 

High-achieving readers 

(Pre-test stanines 7,8,9) 58 62 U2 36 



Total for 12 schoolr;, U j»rades 1,525 
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